Papers with temporal hallucination
TimeR4 : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge in Temporal knowledge graphs (TKTs). |
| Approach: | They propose a Time-aware retrieve-rewrite-retrieve-rerank framework to integrate temporal knowledge from TKGs into Large Language Models (LLMs) to reduce temporal hallucination, they propose rewrite module to rew questions using background knowledge stored in TKG's, then implement a retrieve-rank module to retrieve semantically and temporally relevant facts from Tkgs and rerank them according to temporal constraints. |
| Outcome: | The proposed approach achieves relative gains of 47.8% and 22.5% on two datasets, underscoring its effectiveness in boosting the temporal reasoning abilities of LLMs. |
Mitigating Hallucination in Fictional Character Role-Play (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Influence of parametric knowledge of large language models (LLMs) often causes role-playing characters to act out of character and hallucinate about things outside the scope of their knowledge. |
| Approach: | They propose a method that modulates the influence of parametric knowledge using a pre-calibrated confidence threshold to mitigate hallucination in fictional character role-play. |
| Outcome: | The proposed method reduces the factual accuracy of generated responses by 18% for adversarial questions and 44% in temporal hallucination for time-sensitive interviews. |